Section: New Results

Augmented reality for surgery

We have developed a method for real-time augmented reality of internal liver structures during minimally invasive hepatic surgery. Vessels and tumors computed from pre-operative Computed Tomography Angiograms (CTA) scans can be overlaid onto the laparoscopic view for surgery guidance. Compared to current methods, our method is able to locate the in-depth positions of the tumors based on partial three-dimensional liver tissue motion using a real-time biomechanical model. We are pursuing the development of this augmented reality system by using a better biomechanical model, and by relying on parameter optimization and additional per-operative information to further improve accuracy and robustness. In addition, more experiments, and also clinical studies are being performed to precisely measure the benefits and limitations of our approach. This work is strongly related to our involvement in the IHU Strasbourg and is tightly linked to the SOFA-OR project. Many articles were published on this topic [28] , [16] , [17] .

Figure 9. Electrophysiology model of the human heart